Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	6362620
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	534.0 MiB
Average record size in memory	88.0 B

Variable types

Numeric	6
Categorical	5

Warnings

`nameOrig` has a high cardinality: 6353307 distinct values	High cardinality
`nameDest` has a high cardinality: 2722362 distinct values	High cardinality
`oldbalanceOrg` is highly correlated with `newbalanceOrig`	High correlation
`newbalanceOrig` is highly correlated with `oldbalanceOrg`	High correlation
`oldbalanceDest` is highly correlated with `newbalanceDest`	High correlation
`newbalanceDest` is highly correlated with `oldbalanceDest`	High correlation
`amount` is highly correlated with `oldbalanceDest` and 1 other fields	High correlation
`oldbalanceOrg` is highly correlated with `newbalanceOrig`	High correlation
`newbalanceOrig` is highly correlated with `oldbalanceOrg`	High correlation
`oldbalanceDest` is highly correlated with `amount` and 1 other fields	High correlation
`newbalanceDest` is highly correlated with `amount` and 1 other fields	High correlation
`oldbalanceOrg` is highly correlated with `newbalanceOrig`	High correlation
`newbalanceOrig` is highly correlated with `oldbalanceOrg`	High correlation
`oldbalanceDest` is highly correlated with `newbalanceDest`	High correlation
`newbalanceDest` is highly correlated with `oldbalanceDest`	High correlation
`type` is highly correlated with `newbalanceOrig`	High correlation
`newbalanceOrig` is highly correlated with `type` and 1 other fields	High correlation
`oldbalanceDest` is highly correlated with `newbalanceDest`	High correlation
`oldbalanceOrg` is highly correlated with `newbalanceOrig`	High correlation
`newbalanceDest` is highly correlated with `oldbalanceDest`	High correlation
`amount` is highly skewed (γ1 = 30.99394948)	Skewed
`nameOrig` is uniformly distributed	Uniform
`oldbalanceOrg` has 2102449 (33.0%) zeros	Zeros
`newbalanceOrig` has 3609566 (56.7%) zeros	Zeros
`oldbalanceDest` has 2704388 (42.5%) zeros	Zeros
`newbalanceDest` has 2439433 (38.3%) zeros	Zeros

Reproduction

Analysis started	2021-09-24 18:33:34.929044
Analysis finished	2021-09-24 18:41:29.199482
Duration	7 minutes and 54.27 seconds
Software version	pandas-profiling v3.0.0
Download configuration	config.json

step
Real number (ℝ_≥0)

Distinct	743
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	243.3972456

Minimum	1
Maximum	743
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	156
median	239
Q3	335
95-th percentile	490
Maximum	743
Range	742
Interquartile range (IQR)	179

Descriptive statistics

Standard deviation	142.331971
Coefficient of variation (CV)	0.5847723161
Kurtosis	0.329070555
Mean	243.3972456
Median Absolute Deviation (MAD)	92
Skewness	0.3751768885
Sum	1548644183
Variance	20258.38998
Monotonicity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
19	51352	0.8%
18	49579	0.8%
187	49083	0.8%
235	47491	0.7%
307	46968	0.7%
163	46352	0.7%
139	46054	0.7%
403	45155	0.7%
43	45060	0.7%
355	44787	0.7%
Other values (733)	5890739	92.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2708	< 0.1%
2	1014	< 0.1%
3	552	< 0.1%
4	565	< 0.1%
5	665	< 0.1%
6	1660	< 0.1%
7	6837	0.1%
8	21097	0.3%
9	37628	0.6%
10	35991	0.6%

Value	Count	Frequency (%)
743	8	< 0.1%
742	14	< 0.1%
741	22	< 0.1%
740	6	< 0.1%
739	10	< 0.1%
738	10	< 0.1%
737	10	< 0.1%
736	14	< 0.1%
735	12	< 0.1%
734	8	< 0.1%

type
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

CASH_OUT	2237500
PAYMENT	2151495
CASH_IN	1399284
TRANSFER	532909
DEBIT	41432

Length

Max length	8
Median length	7
Mean length	7.422395963
Min length	5

Characters and Unicode

Total characters	47225885
Distinct characters	18
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	PAYMENT
2nd row	PAYMENT
3rd row	TRANSFER
4th row	CASH_OUT
5th row	PAYMENT

Common Values

Value	Count	Frequency (%)
CASH_OUT	2237500	35.2%
PAYMENT	2151495	33.8%
CASH_IN	1399284	22.0%
TRANSFER	532909	8.4%
DEBIT	41432	0.7%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
cash_out	2237500	35.2%
payment	2151495	33.8%
cash_in	1399284	22.0%
transfer	532909	8.4%
debit	41432	0.7%

Most occurring characters

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	43589101	92.3%
Connector Punctuation	3636784	7.7%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
P	2151495	4.9%
Other values (7)	7425297	17.0%

Connector Punctuation

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	43589101	92.3%
Common	3636784	7.7%

Most frequent character per script

Latin

Value	Count	Frequency (%)
A	6321188	14.5%
T	4963336	11.4%
S	4169693	9.6%
N	4083688	9.4%
C	3636784	8.3%
H	3636784	8.3%
E	2725836	6.3%
O	2237500	5.1%
U	2237500	5.1%
P	2151495	4.9%
Other values (7)	7425297	17.0%

Common

Value	Count	Frequency (%)
_	3636784	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	47225885	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
A	6321188	13.4%
T	4963336	10.5%
S	4169693	8.8%
N	4083688	8.6%
C	3636784	7.7%
H	3636784	7.7%
_	3636784	7.7%
E	2725836	5.8%
O	2237500	4.7%
U	2237500	4.7%
Other values (8)	9576792	20.3%

amount
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	5316900
Distinct (%)	83.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	179861.9035

Minimum	0
Maximum	92445516.64
Zeros	16
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	2224.0995
Q1	13389.57
median	74871.94
Q3	208721.4775
95-th percentile	518634.1965
Maximum	92445516.64
Range	92445516.64
Interquartile range (IQR)	195331.9075

Descriptive statistics

Standard deviation	603858.2315
Coefficient of variation (CV)	3.357343715
Kurtosis	1797.956705
Mean	179861.9035
Median Absolute Deviation (MAD)	68393.655
Skewness	30.99394948
Sum	1.144392945 × 10¹²
Variance	3.646447637 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10000000	3207	0.1%
10000	88	< 0.1%
5000	79	< 0.1%
15000	68	< 0.1%
500	65	< 0.1%
100000	42	< 0.1%
21500	37	< 0.1%
120000	29	< 0.1%
135000	20	< 0.1%
0	16	< 0.1%
Other values (5316890)	6358969	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	16	< 0.1%
0.01	1	< 0.1%
0.02	3	< 0.1%
0.03	2	< 0.1%
0.04	1	< 0.1%
0.06	1	< 0.1%
0.07	1	< 0.1%
0.09	1	< 0.1%
0.1	1	< 0.1%
0.11	2	< 0.1%

Value	Count	Frequency (%)
92445516.64	1	< 0.1%
73823490.36	1	< 0.1%
71172480.42	1	< 0.1%
69886731.3	1	< 0.1%
69337316.27	1	< 0.1%
67500761.29	1	< 0.1%
66761272.21	1	< 0.1%
64234448.19	1	< 0.1%
63847992.58	1	< 0.1%
63294839.63	1	< 0.1%

nameOrig
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	6353307
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C1462946854	3
C363736674	3
C1677795071	3
C400299098	3
C2098525306	3
Other values (6353302)	6362605

Length

Max length	11
Median length	11
Mean length	10.48232332
Min length	5

Characters and Unicode

Total characters	66695040
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	6344009 ?
Unique (%)	99.7%

Sample

1st row	C1231006815
2nd row	C1666544295
3rd row	C1305486145
4th row	C840083671
5th row	C2048537720

Common Values

Value	Count	Frequency (%)
C1462946854	3	< 0.1%
C363736674	3	< 0.1%
C1677795071	3	< 0.1%
C400299098	3	< 0.1%
C2098525306	3	< 0.1%
C1999539787	3	< 0.1%
C1976208114	3	< 0.1%
C1832548028	3	< 0.1%
C2051359467	3	< 0.1%
C1530544995	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c1530544995	3	< 0.1%
c1462946854	3	< 0.1%
c400299098	3	< 0.1%
c1999539787	3	< 0.1%
c545315117	3	< 0.1%
c1065307291	3	< 0.1%
c724452879	3	< 0.1%
c1902386530	3	< 0.1%
c1677795071	3	< 0.1%
c2051359467	3	< 0.1%
Other values (6353297)	6362590	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60332420	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	60332420	90.5%
Latin	6362620	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	8803448	14.6%
2	6136135	10.2%
3	5699596	9.4%
4	5693146	9.4%
7	5669437	9.4%
5	5668010	9.4%
6	5667725	9.4%
0	5667074	9.4%
9	5665212	9.4%
8	5662637	9.4%

Latin

Value	Count	Frequency (%)
C	6362620	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66695040	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	8803448	13.2%
C	6362620	9.5%
2	6136135	9.2%
3	5699596	8.5%
4	5693146	8.5%
7	5669437	8.5%
5	5668010	8.5%
6	5667725	8.5%
0	5667074	8.5%
9	5665212	8.5%

oldbalanceOrg
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	1845844
Distinct (%)	29.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	833883.1041

Minimum	0
Maximum	59585040.37
Zeros	2102449
Zeros (%)	33.0%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	14208
Q3	107315.175
95-th percentile	5823702.278
Maximum	59585040.37
Range	59585040.37
Interquartile range (IQR)	107315.175

Descriptive statistics

Standard deviation	2888242.673
Coefficient of variation (CV)	3.46360618
Kurtosis	32.96487854
Mean	833883.1041
Median Absolute Deviation (MAD)	14208
Skewness	5.249136421
Sum	5.305681316 × 10¹²
Variance	8.341945738 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2102449	33.0%
184	918	< 0.1%
133	914	< 0.1%
195	912	< 0.1%
164	909	< 0.1%
109	908	< 0.1%
181	908	< 0.1%
157	902	< 0.1%
146	899	< 0.1%
136	898	< 0.1%
Other values (1845834)	4252003	66.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2102449	33.0%
0.05	1	< 0.1%
0.18	1	< 0.1%
0.21	1	< 0.1%
0.44	1	< 0.1%
0.67	1	< 0.1%
1	370	< 0.1%
1.02	1	< 0.1%
1.37	1	< 0.1%
1.38	1	< 0.1%

Value	Count	Frequency (%)
59585040.37	1	< 0.1%
57316255.05	1	< 0.1%
50399045.08	1	< 0.1%
49585040.37	1	< 0.1%
47316255.05	1	< 0.1%
45674547.89	1	< 0.1%
44892193.09	1	< 0.1%
43818855.3	1	< 0.1%
43686616.33	1	< 0.1%
42542664.27	1	< 0.1%

newbalanceOrig
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	2682586
Distinct (%)	42.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	855113.6686

Minimum	0
Maximum	49585040.37
Zeros	3609566
Zeros (%)	56.7%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	144258.41
95-th percentile	5980262.336
Maximum	49585040.37
Range	49585040.37
Interquartile range (IQR)	144258.41

Descriptive statistics

Standard deviation	2924048.503
Coefficient of variation (CV)	3.419485164
Kurtosis	32.06698456
Mean	855113.6686
Median Absolute Deviation (MAD)	0
Skewness	5.176884001
Sum	5.44076333 × 10¹²
Variance	8.550059648 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3609566	56.7%
9011.73	4	< 0.1%
7468.59	4	< 0.1%
8927.38	4	< 0.1%
4019.43	4	< 0.1%
7717.83	4	< 0.1%
36875.73	4	< 0.1%
7070.1	4	< 0.1%
10528.49	4	< 0.1%
7802.01	4	< 0.1%
Other values (2682576)	2753018	43.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3609566	56.7%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.05	1	< 0.1%
0.12	1	< 0.1%
0.13	1	< 0.1%
0.18	1	< 0.1%
0.21	1	< 0.1%
0.23	1	< 0.1%
0.3	1	< 0.1%

Value	Count	Frequency (%)
49585040.37	1	< 0.1%
47316255.05	1	< 0.1%
43686616.33	1	< 0.1%
43673802.21	1	< 0.1%
41690842.64	1	< 0.1%
41432359.46	1	< 0.1%
40399045.08	1	< 0.1%
39585040.37	1	< 0.1%
38946233.02	1	< 0.1%
38939424.03	1	< 0.1%

nameDest
Categorical

HIGH CARDINALITY

Distinct	2722362
Distinct (%)	42.8%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

C1286084959	113
C985934102	109
C665576141	105
C2083562754	102
C1590550415	101
Other values (2722357)	6362090

Length

Max length	11
Median length	11
Mean length	10.48175201
Min length	2

Characters and Unicode

Total characters	66691405
Distinct characters	12
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	2262704 ?
Unique (%)	35.6%

Sample

1st row	M1979787155
2nd row	M2044282225
3rd row	C553264065
4th row	C38997010
5th row	M1230701703

Common Values

Value	Count	Frequency (%)
C1286084959	113	< 0.1%
C985934102	109	< 0.1%
C665576141	105	< 0.1%
C2083562754	102	< 0.1%
C1590550415	101	< 0.1%
C248609774	101	< 0.1%
C451111351	99	< 0.1%
C1789550256	99	< 0.1%
C1360767589	98	< 0.1%
C1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c1286084959	113	< 0.1%
c985934102	109	< 0.1%
c665576141	105	< 0.1%
c2083562754	102	< 0.1%
c248609774	101	< 0.1%
c1590550415	101	< 0.1%
c1789550256	99	< 0.1%
c451111351	99	< 0.1%
c1360767589	98	< 0.1%
c1023714065	97	< 0.1%
Other values (2722352)	6361596	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	60328785	90.5%
Uppercase Letter	6362620	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	60328785	90.5%
Latin	6362620	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	8799996	14.6%
2	6133780	10.2%
3	5704404	9.5%
4	5691070	9.4%
8	5675627	9.4%
9	5668861	9.4%
7	5665128	9.4%
0	5664751	9.4%
6	5662897	9.4%
5	5662271	9.4%

Latin

Value	Count	Frequency (%)
C	4211125	66.2%
M	2151495	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66691405	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	8799996	13.2%
2	6133780	9.2%
3	5704404	8.6%
4	5691070	8.5%
8	5675627	8.5%
9	5668861	8.5%
7	5665128	8.5%
0	5664751	8.5%
6	5662897	8.5%
5	5662271	8.5%
Other values (2)	6362620	9.5%

oldbalanceDest
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	3614697
Distinct (%)	56.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1100701.667

Minimum	0
Maximum	356015889.4
Zeros	2704388
Zeros (%)	42.5%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	132705.665
Q3	943036.7075
95-th percentile	5147229.713
Maximum	356015889.4
Range	356015889.4
Interquartile range (IQR)	943036.7075

Descriptive statistics

Standard deviation	3399180.113
Coefficient of variation (CV)	3.088193846
Kurtosis	948.6741254
Mean	1100701.667
Median Absolute Deviation (MAD)	132705.665
Skewness	19.92175792
Sum	7.003346437 × 10¹²
Variance	1.155442544 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2704388	42.5%
10000000	615	< 0.1%
20000000	219	< 0.1%
30000000	86	< 0.1%
40000000	31	< 0.1%
102	21	< 0.1%
198	19	< 0.1%
125	18	< 0.1%
132	18	< 0.1%
160	18	< 0.1%
Other values (3614687)	3657187	57.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2704388	42.5%
0.01	1	< 0.1%
0.03	1	< 0.1%
0.13	1	< 0.1%
0.33	1	< 0.1%
0.37	1	< 0.1%
0.79	1	< 0.1%
1	7	< 0.1%
1.39	1	< 0.1%
1.64	1	< 0.1%

Value	Count	Frequency (%)
356015889.4	1	< 0.1%
355553416.3	1	< 0.1%
355381433.6	1	< 0.1%
355380483.5	1	< 0.1%
355185537.1	1	< 0.1%
328194464.9	1	< 0.1%
327998074.2	1	< 0.1%
327963024	1	< 0.1%
327852121.4	1	< 0.1%
327827763.4	1	< 0.1%

newbalanceDest
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	3555499
Distinct (%)	55.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1224996.398

Minimum	0
Maximum	356179278.9
Zeros	2439433
Zeros (%)	38.3%
Negative	0
Negative (%)	0.0%
Memory size	48.5 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	214661.44
Q3	1111909.25
95-th percentile	5515715.903
Maximum	356179278.9
Range	356179278.9
Interquartile range (IQR)	1111909.25

Descriptive statistics

Standard deviation	3674128.942
Coefficient of variation (CV)	2.999297751
Kurtosis	862.1565079
Mean	1224996.398
Median Absolute Deviation (MAD)	214661.44
Skewness	19.35230206
Sum	7.794186583 × 10¹²
Variance	1.349922348 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2439433	38.3%
10000000	53	< 0.1%
971418.91	32	< 0.1%
19169204.93	29	< 0.1%
16532032.16	25	< 0.1%
1254956.07	25	< 0.1%
1412484.09	22	< 0.1%
1178808.14	21	< 0.1%
4743010.67	21	< 0.1%
7364724.84	21	< 0.1%
Other values (3555489)	3922938	61.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2439433	38.3%
0.01	1	< 0.1%
0.33	1	< 0.1%
1.39	1	< 0.1%
1.64	1	< 0.1%
1.74	1	< 0.1%
2.15	1	< 0.1%
2.45	1	< 0.1%
2.71	1	< 0.1%
2.76	1	< 0.1%

Value	Count	Frequency (%)
356179278.9	1	< 0.1%
356015889.4	1	< 0.1%
355553416.3	2	< 0.1%
355381433.6	1	< 0.1%
355380483.5	1	< 0.1%
355185537.1	1	< 0.1%
328431698.2	1	< 0.1%
328194464.9	1	< 0.1%
327998074.2	1	< 0.1%
327963024	1	< 0.1%

isFraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6354407
1	8213

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	1
4th row	1
5th row	0

Common Values

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	6354407	99.9%
1	8213	0.1%

isFlaggedFraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	48.5 MiB

0	6362604
1	16

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	6362620
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6362620	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	6362620	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6362620	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	6362604	> 99.9%
1	16	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	step	type	amount	nameOrig	oldbalanceOrg	newbalanceOrig	nameDest	oldbalanceDest	newbalanceDest	isFraud
0	1	PAYMENT	9839.64	C1231006815	170136.00	160296.36	M1979787155	0.0	0.00	0
1	1	PAYMENT	1864.28	C1666544295	21249.00	19384.72	M2044282225	0.0	0.00	0
2	1	TRANSFER	181.00	C1305486145	181.00	0.00	C553264065	0.0	0.00	1
3	1	CASH_OUT	181.00	C840083671	181.00	0.00	C38997010	21182.0	0.00	1
4	1	PAYMENT	11668.14	C2048537720	41554.00	29885.86	M1230701703	0.0	0.00	0
5	1	PAYMENT	7817.71	C90045638	53860.00	46042.29	M573487274	0.0	0.00	0
6	1	PAYMENT	7107.77	C154988899	183195.00	176087.23	M408069119	0.0	0.00	0
7	1	PAYMENT	7861.64	C1912850431	176087.23	168225.59	M633326333	0.0	0.00	0
8	1	PAYMENT	4024.36	C1265012928	2671.00	0.00	M1176932104	0.0	0.00	0
9	1	DEBIT	5337.77	C712410124	41720.00	36382.23	C195600860	41898.0	40348.79	0

Last rows

	step	type	amount	nameOrig	oldbalanceOrg	nameDest	oldbalanceDest	newbalanceDest	isFraud
6362610	742	TRANSFER	63416.99	C778071008	63416.99	C1812552860	0.00	0.00	1
6362611	742	CASH_OUT	63416.99	C994950684	63416.99	C1662241365	276433.18	339850.17	1
6362612	743	TRANSFER	1258818.82	C1531301470	1258818.82	C1470998563	0.00	0.00	1
6362613	743	CASH_OUT	1258818.82	C1436118706	1258818.82	C1240760502	503464.50	1762283.33	1
6362614	743	TRANSFER	339682.13	C2013999242	339682.13	C1850423904	0.00	0.00	1
6362615	743	CASH_OUT	339682.13	C786484425	339682.13	C776919290	0.00	339682.13	1
6362616	743	TRANSFER	6311409.28	C1529008245	6311409.28	C1881841831	0.00	0.00	1
6362617	743	CASH_OUT	6311409.28	C1162922333	6311409.28	C1365125890	68488.84	6379898.11	1
6362618	743	TRANSFER	850002.52	C1685995037	850002.52	C2080388513	0.00	0.00	1
6362619	743	CASH_OUT	850002.52	C1280323807	850002.52	C873221189	6510099.11	7360101.63	1

Overview

Variables

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Connector Punctuation

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample